Information Extraction System Evaluation
نویسنده
چکیده
This year, project efforts are focused on reapplying and revising existing evaluation techniques for the purpose of evaluating English and Japanese information extraction systems in the joint ventures and microelectronics domains. This year's effort will culminate in the Fifth Message Understanding Conference (MUC-5) in August, 1993. development in March, 1993, in preparation for the evaluation in July and the conference in August. Over 20 organizations (including Tipster-sponsored organizations) are planning to participate. Most of the non-Tipster organizations will be working only on the English joint ventures task or the English microelectronics task; however, two will be working on joint ventures in both languages, and one will be working on microelectronics in Japanese only.
منابع مشابه
Design and evaluation of an ontology based information extraction system for radiological reports
This paper describes an information extraction system that extracts and converts the available information in free text Turkish radiology reports into a structured information model using manually created extraction rules and domain ontology. The ontology provides flexibility in the design of extraction rules, and determines the information model for the extracted semantic information. Although...
متن کاملHow to Evaluate Health Information Systems: Evaluation stages
The most important goal of health systems is improvement of quality, effectiveness and efficiency of health services. To achieve this goal, health care organizations should establish a proper structure for evaluating health information systems. Health information system evaluation is expected to identify the existing problems of the system through measuring specific indicators. The main objecti...
متن کاملCASIANED: People Attribute Extraction based on Information Extraction
In this paper, we describe the people attribute extraction system of the CASIANED team for the second Web People search evaluation (WePS-2). We develop an attribute extraction system based on information extraction. Firstly the attribute candidates for every attribute class are extracted using several different information extraction techniques; then these candidates are verified through classi...
متن کاملTIPSTER/MUC-5 Information Extraction System Evaluation
Three information extraction system evaluations using Tipster data were conducted in the context of Phase 1 of the Tipster Text program. Interim evaluations were conducted in September, 1992, and February, 1993; the final evaluation was conducted in July, 1993. The final evaluation included not only the Tipster-supported inform~on extraction contractors but thirteen other participants as well. ...
متن کاملSome statistical methods for evaluating information extraction systems
We present new statistical methods for evaluating information extraction systems. The methods were developed to evaluate a system used by political scientists to extract event information from news leads about international politics. The nature of this data presents two problems for evaluators: 1) the frequency distribution of event types in international event data is strongly skewed, so a ran...
متن کاملAn Evaluation of Audio Feature Extraction Toolboxes
Audio feature extraction underpins a massive proportion of audio processing, music information retrieval, audio effect design and audio synthesis. Design, analysis, synthesis and evaluation often rely on audio features, but there are a large and diverse range of feature extraction tools presented to the community. An evaluation of existing audio feature extraction libraries was undertaken. Ten ...
متن کامل